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Abstract 

Introduction: To improve communication in the integrated care setting of children with cerebral palsy, we developed a web-based system 
for parent-professional and inter-professional communication. The present study aimed to evaluate parents' experiences regarding the 
system's contribution to their communication with professionals during a six-months pilot in three Dutch care regions. In addition, factors 
associated with parents' system use and non-use were analyzed. 

Theory and methods: The system's functional specifications were based on key elements of the Chronic Care Model and quality 
dimensions formulated by the Institute of Medicine. At baseline, parents completed a TO-questionnaire on their experiences regarding 
sufficiency of contact, accessibility of professionals, timeliness of information exchange, consistency of information and parents' role as 
messenger of information and/or care coordinator. After the pilot, parents completed a Tl -questionnaire on their experiences regarding 
the system's contribution to each of these aspects. 

Results: Of the 30 participating parents 21 had used the system, of which 20 completed the Tl -questionnaire. All these parents indicated 
that they had experienced a contribution of the system to parent-professional communication, especially with respect to accessibility of 
professionals, sufficiency of contact and timeliness of information exchange, and to a lesser extent consistency of information and parents' 
messenger/coordinator role. In comparison with non-users, users had less positive baseline experiences with accessibility and a higher 
number of professionals in the child's care network. 

Conclusions: All users indicated a contribution of the system to parent-professional communication, although the extent of the experi- 
enced contribution varied considerably. Based on the differences found between users and non-users, further research might focus on the 
system's value for complex care networks and problematic access to professionals. 
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Introduction 

Children with special health care needs (CSHCN) are 
an important population from health care services, 
economic and policy perspectives [1]. The often highly 
specific and heterogeneous care needs in this popula- 
tion require a broad range of long-term care services 
from multiple providers across diverse organisations 
and sectors. A primary aim in such inter-disciplinary 
and inter-organizational settings is to provide inte- 
grated and coordinared care across all elements of the 
health care system and the patient's community [2]. 
This, however, is increasingly difficult to realize given 
the high level of differentiation (between professionals, 
units, organisations) [3] and the resulting complexity of 
health care, characterized by "more to know, more to 
do, more to manage, more to watch, and more people 
involved than ever before" [4]. Particularly for the rap- 
idly growing population of chronic patients with multiple 
concurrent conditions, health care organizations often 
operate as silos, providing care without complete infor- 
mation about the patient's condition, medical history or 
services provided in other settings [4]. In their report 
Crossing the quality chasm, the Institute of Medicine 
emphasized that health care should be patient-cen- 
tered, specifying care coordination and integration as 
one of its key features in order to ensure that accurate 
information reaches those who need it at the appropri- 
ate time [4]. Hereto, effective communication within the 
health care system and between the health care system 
and the larger community is of vital importance [4-6] 
and a fundamental feature in parents' experiencing 
services as connected or coordinated [7]. In practice, 
however, inadequate communication among health 
care providers and organizations involved in the child's 
care is one of the main barriers that challenge care 
coordination in paediatric services [8]. Based on data of 
the US National Survey of CSHCN [9], a study among 
CSHCN populations with neurological conditions found 

Box 1. Integrated care for children with cerebral palsy 



that children with multiple conditions had the greatest 
unmet needs and dissatisfaction with care coordina- 
tion, which was defined in terms of communication 
among doctors and between doctors and other pro- 
viders and whether the family received sufficient help 
coordinating care, if needed [10]. Failure of profession- 
als caring for the same child to communicate with one 
another often leaves the parents as information inter- 
mediaries [11] and/or semi-professional care coordina- 
tors [7]. This corresponds to our findings on the care of 
children with cerebral palsy in The Netherlands (Box 1) 
in which we identified various gaps in communication, 
such as inadequate cooperation of professionals and 
an experienced lack of patient-centeredness, as well 
as insufficient inter-professional contact necessitating 
parents to take up the role of messenger of information 
and/or care coordinator [21]. 

Although much has been written about the potential of 
eHealth technology to stimulate integrated care across 
patient conditions, services and sites [22-24], applica- 
tions in paediatrics have been relatively scarce [25]. 
More recently, however, they are increasingly being 
applied to facilitate communication between health 
care providers and caregivers of paediatric patients 
with health conditions requiring follow-up [26, 27]. 
Based on the identified gaps in three Dutch cerebral 
palsy care regions (Box 2), we aimed to obtain insight 
in the feasibility and usability of an eHealth applica- 
tion to improve patient care communication in these 
settings. Hereto, we developed a web-based system 
for parent-professional and inter-professional commu- 
nication [31], aimed to increase patient-centeredness, 
facilitate inter-professional contact and enhance net- 
work transparency (see Appendix). Representing an 
'innovator' phase [32, 33], early prototypes of eHealth 
technology are generally evaluated on technical stabil- 
ity and user acceptance [34, 35]. As the system proved 
to be technically feasible in a six-months pilot in three 
Dutch care regions and most parents reported added 



Cerebral palsy is one of the most severe chronic disabilities in childhood, often making strong demands on health, education and social 
services as well as on families and children themselves [12]. In The Netherlands, children with cerebral palsy are the largest diagnostic 
group treated in paediatric rehabilitation [13], with a prevalence ranging from 1.5 to 2.5 per 1000 live births with little or no variation among 
Western nations [14, 15]. Cerebral palsy has usually been defined as an umbrella term covering a group of motor disorders caused by a 
non-progressive lesion of the immature brain [16]. More recently, activity limitation was added as conditional feature and an annotation was 
made that the motor disorders are often accompanied by disturbances of sensation, perception, cognition, communication, and behaviour, by 
epilepsy, and by secondary musculoskeletal problems [17]. As no two children are affected in the same way, individual treatment programs 
vary widely, presenting care providers with heterogeneous and complex diagnostic and therapeutic challenges, requiring a broad range 
of specialized services from various professionals across diverse institutions and settings [18]. Although one of the primary aims in such 
interdisciplinary and -organizational settings is to provide integrated care, a study on integrated paediatric services in The Netherlands 
concluded that despite the fact that family-centered and coordinated care are seen as the two most desirable and effective ways of paediatric 
care delivery, their practical implementation in Dutch paediatric practice is still in a preliminary stage [19]. In line with this, a descriptive quality 
inventory of cerebral palsy care in The Netherlands identified suboptimal communication across institutions and settings as one of the main 
gaps in care coordination [20]. In view of these challenges, the overall aim of our study is to contribute to the improvement of patient care 
communication across the integrated care setting of cerebral palsy in three Dutch care regions. 
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value in using the system [31], the present study aimed 
to evaluate parents' experiences regarding the sys- 
tem's contribution to their communication with involved 
professionals during the six-months pilot. Hereto, we 
focused on those aspects of parent-professional com- 
munication in which we previously identified gaps and 
hence were targets of improvement for the web-based 
system, being sufficiency of contact, timeliness of infor- 
mation exchange, accessibility of professionals, con- 
sistency of information and the extent to which parents 
felt they had to act as care coordinator or messenger 
of information between professionals. In addition, we 
aimed to gain insight into factors related to parents' sys- 
tem use and non-use, by comparing parents who had 
used the system (n=21) with those who had not used 
the system (n=9) with respect to their baseline experi- 
ences with parent-professional communication and the 
complexity of their child's care network, hypothesizing 
that users would have less positive baseline experi- 
ences and a more complex care network. 

Theory and methods 

System aims 

Following the Chronic Care Model [29], produc- 
tive interactions between the patientfs family) and 
involved practice teams arise from essential system 
changes at the health care organization level, such 
as self-management support, delivery system design, 
decision support and clinical information systems [6]. 

Box 2. Improving communication in cerebral palsy care 



Although eHealth technology has the potential to con- 
tribute to each of these system changes [36], changes 
with respect to self-management support (how to help 
patients live with their conditions) and delivery system 
design (who's on the health care team and in what ways 
they interact with patients) will relatively be most visible 
to the patientfs family) [6]. As the identified gaps in our 
study (Box 2) particularly reflected improvement needs 
in these domains, the primary aims of the web-based 
system were to increase patient-centeredness, facili- 
tate inter-professional contact and enhance network 
transparency. In the Appendix, an overview is given of 
these aims and the corresponding design features. In 
the present study, we focused on the system's aim to 
increase patient-centeredness and hereto evaluated 
parents' experiences regarding the system's contribu- 
tion to their communication with involved professionals 
during the six-months pilot. 

Study population 

In order to obtain data representative for the integrated 
care setting of cerebral palsy, three Dutch care regions 
were included ranging from urban to more rural set- 
tings. The selection of patients was carried out by a 
rehabilitation physician, based on files of patients with 
annual supervision and the following selection criteria: 
(1) diagnosis cerebral palsy (confirmed by neurologist) 
and (2) age between 4-8 years [from the age of four 
years diagnosis is mostly clear and (special) education 
becomes an additional communication partner in the 



To identify experienced gaps in communication across the integrated care setting of cerebral palsy, we searched the literature for appropriate 
research methodology. Existing methods though were often restricted to only one aspect of communication (e.g. discharge- or referral 
communication), one communication link (e.g. general practitioner — hospital specialist) or one evaluation perspective (e.g. the perspective 
of primary care physicians), or relied solely on quantitative-resp. qualitative methods, thus obtaining either general/population based data 
or in-depth qualitative data derived from small samples [28]. In view of these shortcomings, we developed a mixed method evaluation 
approach [28], based on key elements of the Chronic Care Model [6, 29], quality of care aspects formulated by the Institute of Medicine [4] 
and essential quality dimensions of information(-exchange) [30]. Application of this approach in three Dutch cerebral palsy care regions [21] 
showed that parents primarily experienced gaps in inter-professional communication, particularly between the (rehabilitation) hospital and 
primary care physiotherapy resp. (special) education/day care centre. Subsequent in-depth interviews with a subset of parents showed that 
the experienced gaps were primarily related to inadequate cooperation of professionals and an experienced lack of patient-centeredness, 
as well as insufficient inter-professional information-exchange and consistency of information, which often necessitated parents to take 
up the role of messenger of information or even that of care coordinator [21]. Confronting professionals with these findings yielded further 
understanding of underlying factors, such as capacity problems and a lack of interdisciplinary guidelines and clear definition of roles, tasks 
and responsibilities [21]. 

Based on these gaps in communication, we developed an asynchronous secure web-based system for parent-professional and inter- 
professional communication, aimed at increasing patient centeredness, facilitating inter-professional contact and enhancing network 
transparency [31]. For each of these aims, functional specifications were formulated, which were subsequently translated into technical 
requirements (see Appendix). Based on the findings of a six-month pilot-evaluation in three Dutch care regions, the system proved to be 
technically robust and reliable [31]. Approximately two-thirds of the parents and half of the professionals had used the system, of which 
most parents and some professionals reported to have experienced added value in its use [31], comprising each of the three system aims: 
patient-centeredness (parents could ask questions at the moment they arose and the whole network could be reached at once, avoiding 
fruitless phone calls), inter-professional contact (lower threshold for consultation, contact with disciplines which previously were not actively 
involved in decision making) and network transparency (professionals were being kept up to date between visits, obtaining insight about 
other professionals' advice; parents could re-view their communication with professionals) [31]. 
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care network]. Parents needed to have (1) sufficient 
Dutch language skills (as judged by the rehabilitation 
physician) in order to be able to use the communication 
system and complete questionnaires and (2) access to 
the internet as well as basic knowledge how to use it. 
Finally, minimal three involved professionals [i.e. the 
child's rehabilitation physician, (primary care) physio- 
therapist and professional of (special) education/day 
care centre] needed to participate in the study in order 
to have a sufficient network for communication. On 
the basis of these criteria, the parents of 30 cerebral 
palsy patients were included in the study. After com- 
pletion of informed consent they received log-in data 
for access to the system. The study was conducted in 
keeping with the protocol of the WMA Declaration of 
Helsinki. According to Dutch legislation (WMO Medi- 
cal Research Involving Human Subjects Act) a medical 
ethics review was not required. 

System use and non-use 

System use was on a voluntary basis, i.e. parents 
were free in their choice to use the system in a given 
situation or apply their usual modes of communication 
(face-to-face, telephone etc.). The system comprised 
an open access part (a generally accessible website 
with project related information) and a personalized 
secured access part with various consultation options. 
Parents could contact professionals in their child's care 
network, while professionals could contact both par- 
ents as well as colleague-professionals involved in the 
patient's care network. For each submitted question 
parents had to mark one feedback-responsible profes- 
sional, an automatic copy was sent to other involved 
professionals (parents could remove this option if pre- 
ferred, see Appendix). Information about parents' sys- 
tem use was extracted from the system's database. Of 
the 30 participating parents, 21 had actually used the 
system during the six-months pilot by submitting one 
or more questions and/or responses to professionals, 
whereas nine parents had only logged into the system 
without submitting a question/response. Considering 
the system's aim to improve parent-professional and 
inter-professional communication, system use was 
defined in terms of submitting a question/response on 
the system more than once. Consequently, trying out 
the system only once or logging-in without submitting a 
question/response was not considered actual system 
use. 

Study design 

Baseline questionnaire (TO) 

In order to describe the study population and to evaluate 
parents' experiences with parent-professional communi- 



cation before the pilot, parents completed a baseline 
questionnaire, including parent/patient characteristics, 
frequency and modes of contact with involved profes- 
sionals in the child's care network and parents' expe- 
riences regarding their communication with these 
professionals, focusing on sufficiency of contact, timeli- 
ness of information exchange, accessibility of profes- 
sionals, consistency of information and the extent to 
which parents felt they had to act as care coordinator 
and/or messenger of information between profession- 
als. For each of these aspects a scoring table was used 
in which parents could indicate for each involved pro- 
fessional the extent to which they had experienced suf- 
ficient contact/timely information exchange etc. during 
the preceding six months (3-point Likert scale 'usually', 
'occasionally' or 'rarely', see Appendix). 

Questionnaire after six-month pilot (Tl) 

After the pilot parents completed a questionnaire on 
the experienced contribution of the system to each of 
these aspects of parent-professional communication. 
In addition, parents were asked whether they less often 
needed face-to-face/telephone contact with involved 
professionals as a result of using the system. For the 
items sufficiency of contact, timeliness of information 
exchange and accessibility of professionals, the experi- 
enced contribution was evaluated by means of scoring 
tables in which parents could indicate for each involved 
professional the extent to which they had experienced 
a contribution of the system (3-point Likert scale 'con- 
siderably', 'to some extent' or '(hardly) not', see Appen- 
dix). For the items consistency of information and the 
coordinator/messenger role, detailed evaluation per 
professional was considered less appropriate given 
the inter-dependency among professionals that is 
inherent to these aspects of parent-professional com- 
munication. Therefore instead of using scoring tables, 
the experienced contribution for these items was eval- 
uated by means of a 5-point Likert-scale (ranging from 
'yes, definitely' to 'no, not at all', see Appendix). 

Data analysis 

Parents' questionnaire responses T0/T1 

Parents' TO questionnaire responses were listed in an 
overall table, indicating for each parent the proportion 
of professionals that were scored with a positive/inter- 
mediate/negative response (respectively 'usually! 'occ- 
asionally'I'rarely', see Table 1). As such, the intermedi- 
ate and negative responses represented experienced 
shortcomings in parent-professional communication 
and thus targets for improvement of the communica- 
tion system. 

Parents' T1 questionnaire responses on the items suf- 
ficiency of contact, timeliness of information exchange 
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Table 1. Parents' baseline experiences regarding parent-professional communication 



Sufficiency 



With this professional I 
[.....] had sufficient 
contact 



Timeliness 



With this professional I 

[.....] had timely 
information exchange 



Accessibility 



This professional was 
[.....] accessible for 
consultation 



Consistency 



Of this professional I 
[.....] received consistent 
information 



Coordinator 



With this professional I 
[.....] felt I had to act as 
care coordinator 



Messenger 



With this professional I 
[.....] felt I had to act as 
messenger of 
information 



Parent 




55 


10 


177 


31 


9 


158 


48 


7 


151 


19 


2 


126 


42 I 


17 


88 47 


23% 


4% 


| 82% 


14% 


4% 


74% 


23% 


3% 


88% 


11% 


1% 


68% 


23% | 


9% 


57% 31% 



73% (n=22) 



57% (n=17) 



63% (n=19) 



38% (n=10) 



72% (n=21) 



79% (n=22) 



'Usually' 
= 'Occasionally' 

- 'Rarely' 

- Missing value 



'Rarely' 
I = 'Occasionally' 
\ = 'Usually' 
- Missing value 



and accessibility of professionals were listed in an overall 
table, indicating parent's responses regarding the expe- 
rienced contribution of the system for each involved pro- 
fessional that participated in the study ['considerably', 
'to some extentT(hardly) not', see Table 3]. 

Factors associated with parents' system use 
and non-use 

To evaluate whether parents' system use was asso- 
ciated with their baseline experiences regarding 
parent-professional communication, the TO-ques- 
tionnaire responses of parents who had used the 
system (use-group, n=21) were compared with the 
responses of parents who had not used the system 
(non-use group, n=9), focusing on the proportion of 
professionals that were scored with a positive experi- 
ence on the concerning aspect of parent-professional 
communication. Given the skewed distribution of 
these proportions, non-parametric tests for indepen- 
dent samples were applied (Mann-Whitney, a=0.05), 
using one-sided p-values in line with our hypothesis 



that the use-group would have less positive baseline 
experiences with parent-professional communication 
and thus the proportion of professionals that were 
scored with a positive experience would be lower 
than in the non-use group. In addition, we evaluated 
whether the complexity of their child's care network 
was associated with parents' system use, by compar- 
ing the amount of involved professionals and institu- 
tions between the use and non-use group. For this 
comparison independent-sample t-tests were applied 
(a=0.05), using one-sided p-values in line with our 
hypothesis that the amount of involved professionals 
and institutions would be higher in the use-group than 
in the non-use-group. 

Results 

Parents' baseline experiences (TO) 

Table 1 summarises parents' responses at baseline, 
both for the parents who had used the system (use, 
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n=21) and the parents who had not used it during the 
six-month pilot (non-use, n=9). The numbers repre- 
sent the number of professionals that were marked 
with a positive (white label), intermediate (grey label) 
or negative response (black label). As can be seen in 
the vertical total scores, the majority of professionals 
were marked with a positive response, although the 
proportion of positive responses differed between the 
items, ranging from 88% for consistency of informa- 
tion to 57% for parents as messenger of information. 
However, looking horizontally at the individual parent 
level, each parent had scored intermediate or nega- 
tive responses on one or more items. A relatively high 
proportion of parents indicated that they had to act as 
care coordinator or messenger of information: resp. 21 
out of 29 parents (72%) and 22 out of 28 parents (79%) 
had scored one or more professionals with an interme- 
diate and/or negative response. Of the professionals 
that were marked with a negative response (n=26), the 
majority were medical specialists (n=14) and paramed- 
ical therapists in (special) education-/day care centres 
(n=8). 

Parents' system use during the six- 
month pilot 

Of the 30 participating parents, 21 parents had actually 
used the system, submitting n=111 questions and n=59 
responses, with a mean of five questions (range 1-17) 
and three responses (range 1-9) per parent. As can be 
seen in Table 2, the rehabilitation physician was most 
frequently marked as feedback-responsible profes- 
sional (41% of the 111 submitted questions), next to the 
physiotherapist and occupational therapist (respectively 
20% and 14% of the 111 submitted questions). Overall, 
(para-)medical professionals were feedback-respon- 
sible for the far majority of parents' questions (90%), 
whereas education professionals were addressed for 
feedback in only 10% of the submitted questions. 

Experienced contribution of the system 
(Tl) 

Of the 21 parents that had used the system, 20 com- 
pleted the T1 -questionnaire. Table 3 shows their 
responses regarding the experienced contribution of 
the system to respectively sufficiency of contact (s), 
accessibility of professionals (a) and timelinesss of 
information exchange (t) for each involved professional 
that participated in the system's pilot. As can be seen 
in the overall scores at the bottom of the the table, 
all 20 parents that completed the T1 -questionnaire 
indicated that for one or more involved professionals 
the system had to a greater or lesser extent-contrib- 
uted to sufficient contact, accessibility and/or timely 



Table 2. Overview of feedback-responsible professionals in parents' 
submitted questions (n=111). 



Questions 



n % 



Care 




Region A (urban) 


34 


31 


region 




Region B (urban/rural) 


16 


14 






Region C (rural) 


61 


55 


Institution 




Hospital 


27 


24 






Rehabilitation centre 


48 


43 






(Special) education/day 


19 


17 






care centre 










Primary care centre 


17 


15 


Discipline 




Medical 


A Q 


A A 
44 






Paramedical 


ol 


A d. 

4b 






CUUUdllUI ldl 


I I 


I u 




Mprlipal 

IVIOUIOCll 


Rphohjl jtatinn nh\/Qipian 
I \d I a vjw I la i\KJ\ I yji lyoioicii I 


45 


41 






Paediatrician 


3 


3 






Paediatric neurologist 


1 


1 




Paramedical 


Physiotherapist 


22 


20 






Occupational therapist 


15 


14 






Manufacturer 


5 


5 






rehabilitation aids 










Speech therapist 


2 


2 






Social work 


2 


2 






Orthoptist 


2 


2 






Pedagogue 


1 


1 






Dietician 


1 


1 






Creative therapist 


1 


1 




Educational 


Teacher 


8 


7 






(Ambulant) supervisor 


2 


2 






Group leader (day 


1 


1 






care) 







information exchange. In total 14 parents indicated 
that the system had 'considerably' contributed to suf- 
ficient contact with one or more involved profession- 
als, particularly the rehabilitation physician (indicated 
by 10 parents) and the physiotherapist (five parents). 
With respect to accessibility and timely information 
exchange, in total 13 parents indicated a considerable 
contribution of the system, again particularly for the 
rehabilitation physician (indicated by resp. 8/9 parents) 
and the physiotherapist (indicated by resp. 9/10 par- 
ents). As can be further seen in the table, the number 
of times that professionals were marked as feedback- 
responsible for a submitted question (total n=111) was 
related to the experienced contribution of the system. 
For those professionals that had not been marked as 
feedback-responsible for a submitted question (n=0), 
parents mostly did not experience a contribution of 
the system. On the other hand, the table shows that 
even when a professional was only marked once as 
feedback-responsible for a submitted question (n=1), 
various parents indicated that they had experienced a 
considerable contribution of the system for that par- 
ticular professional. 

Considering parents' responses regarding the expe- 
rienced contribution of the system to consistency of 
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Table 3. Parents' responses regarding the experienced contribution of the system to sufficiency of contact (s), accessibility of professionals (a) and 
timelinesss of information exchange (t) 



T1 


Region A 


Region B 


Region C 


Parent 
1 


Parent 
2 


Parent 
3 


Parent 
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Parent 
5 


Parent 
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Parent 
7 


Parent 
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Parent 
9 


Parent 
10 


Parent 
11 


Parent 
12 


Parent 
13 
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14 
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15 


Parent 
16 
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17 
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18 


Parent 
19 
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20 
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21 
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Orthoptist 
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information and parents' messenger/coordinator role, 
less than half of the 20 parents (n=9) indicated a posi- 
tive response on these items (10%-25% did not know 
and 25%-35% indicated a negative response). 

Factors associated with parents' 
system use and non-use 

Comparing the 21 parents who used the system 
with the nine parents who had not used the system, 
the non-users scored relatively higher at baseline on 
accessibility of professionals: 89% of the profession- 
als were marked with a positive experience on this 
item, compared to 68% for the users, a statistically sig- 
nificant difference (p=0.023). With respect to parents' 
baseline experiences regarding sufficiency of contact, 
both groups scored nearly the same (in the non-use 
group 75% of the professionals were marked with a 
positive response on this item, compared to 72% in the 
use-group). For the remainder of the items, the use- 
group scored higher than the non-use group, although 
no significant differences were found. 



Comparing the complexity of the child's care network 
between both groups, the mean number of involved 
professionals in the use-group was 8.3 (range 5-14) 
compared to 5.7 (range 3-10) in the non-use group, a 
statistically significant difference (p=0.006). The mean 
number of involved institutions was higher in the use 
group (mean 4.1 , range 2-7) compared to the non-use 
group (mean 3.7, range 2-5), although this was not a 
significant difference. 

Discussion 

Although the rationale for integrated care is often 
approached from a system/-organisational perspec- 
tive in terms of efficiency and cost-effectiveness, 
the patient-centered imperative and meaning is of 
increasing importance [37]. In orderto improve parent- 
professional and inter-professional communication in 
the integrated care setting of children with cerebral 
palsy, we developed a web-based communication 
system aimed at increasing patient centeredness, 
facilitating inter-professional contact and enhancing 
network transparency. The aim of this study was to 
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evaluate parents' experiences regarding the system's 
contribution to their communication with involved pro- 
fessionals. Based on previous findings [21], the sys- 
tem was expected to contribute to sufficient contact, 
timely information exchange, accessibility of profes- 
sionals and consistency of information, as well as to 
decrease the need for parents to act as care coor- 
dinator and messenger of information between pro- 
fessionals. Of the 30 parents that participated in the 
six-months pilot, 21 had used the system. At baseline, 
all of them generally experienced good communica- 
tion with the majority of professionals, but each par- 
ent also experienced gaps on one or more aspects, 
especially sufficiency of contact, accessibility of pro- 
fessionals and the coordinator/messenger role. This 
corresponds with findings in literature, in which par- 
ents reported being the only coordinators of care for 
their children or the primary method of communica- 
tion between physicians [7, 11]. Of the 20 users that 
completed the T1 questionnaire, all had experienced 
a contribution of the system on one or more aspects. 
The majority of parents indicated to have experienced 
a contribution of the system on sufficiency of contact, 
timely information exchange and accessibility of pro- 
fessionals, whereas consistency of information and 
the extent to which parents feel care coordinator or 
messenger of information seemed less influenced by 
the system. The higher experienced contribution on 
sufficiency, timeliness and accessibility could be due 
to a more direct impact of the system on these items, 
whereas the other aspects might be more dependent 
on other modes of communication (face-to-face/tele- 
phone contact) as well, each affecting consistency 
of information and the extent to which parents feel 
care coordinator/messenger of information. Improve- 
ment of these aspects might be stimulated through 
parent-professional discussion of these issues, in 
which parents are given choices about their role in 
communicating information between professionals 
[11]. From a methodological point of view, the differ- 
ences in experienced contribution could also be due 
to the fact that the items sufficiency, timeliness and 
accessibility were assessed by means of a scoring 
table (in which experienced contribution was opera- 
tionalized on the level of individual professionals), 
whereas the system's contribution to the other items 
were assessed in more general terms by means of 
a 5-point Likert scale in which parents could only 
give overall scores. The choice for a more generic 
evaluation for these items was made after analysis 
of parents' responses in the baseline questionnaire, 
in which detailed evaluation per professional turned 
out to be less appropriate considering the inter-de- 
pendent nature inherent to these aspects of parent- 
professional communication. 



Although all users had experienced a contribution of 
the system on one or more aspects, the extent of the 
experienced contribution varied considerably: some 
parents experienced a contribution on only one aspect 
and for just one or two involved professionals, while 
other parents experienced a contribution on more 
aspects and for various professionals. This might be 
partly explained by parents' differing baseline experi- 
ences, but another factor might be the broad varia- 
tion in frequency of system use (with a mean of n=8 
questions/responses per parent, standard deviation 
6 and range 2-20). Parents who used the system 
more frequently might be more likely to have expe- 
rienced a contribution of the system, although our 
findings showed that just one submitted question 
could also positively contribute to parent-professional 
communication. 

Considering the applied methodology to evaluate 
parents' experiences, the choice for detailed scoring 
tables was made in order to evaluate parents' experi- 
ences for each involved professional, and thereby to 
detect potential disciplines for whom the web-based 
system might have particular added value. Based 
on the findings in the present study, this seemed to 
be the case for the rehabilitation physician and the 
physiotherapist, whom parents frequently marked 
as feedback-responsible professionals in submit- 
ted questions, and for whom parents experienced a 
considerable system contribution to sufficient con- 
tact, accessibility and/or timely information exchange. 
However, the reliability of parents' responses was 
suboptimal, as could be seen in the total number of 
marked professionals in the baseline questionnaire 
question item. A more overall quantitative measure 
or qualitative evaluation might have additional value, 
although the possibility to detect changes per profes- 
sional would be lost. 

Of the participating parents, almost one-third had not 
used the system. At baseline, these parents scored 
significantly higher on accessibility of professionals, 
which might partly explain their non-use of the sys- 
tem: they already could reach their professionals rela- 
tively easily. In these situations of good accessibility 
of professionals, a web-based system might therefore 
be less indicated. In line with this, we found that the 
complexity of the care network (measured by means of 
the amount of involved professionals and institutions) 
was higher in the use-group than in the non-use group. 
Based on the differences found between the use- and 
non-use group, we hypothesize that the system may 
be especially valuable in patient populations with com- 
plex care networks involving multiple professionals and 
institutions, and less positive experiences with acces- 
sibility of professionals. 



This article is published in a peer reviewed section of the International Journal of Integrated Care 



8 



International Journal of Integrated Care - Volume 12, 6 March - URN:NBN:NL:UI:10-1-112786 / ijic2011 -152- http://www.ijic.org/ 



Conclusions 

All users experienced a contribution of the system to 
parent-professional communication, although the extent 
of the experienced contribution varied considerably. The 
strength of the system appears to lie in its contribution 
to sufficient contact, timely information exchange and 
accessibility of professionals, whereas consistency of 
information and the coordinator/messenger role seemed 
less influenced by the system. In line with a staged 
approach of telemedicine evaluation, these findings 
can be taken into account in the further development 
of the system, ranging from optimization of the system 
by expanding consultation possibilities and providing 
insight into the consultation process, to a more specific 
definition of the system's target population, focusing on 
patient populations with complex care networks and 
problematic access to professionals. In addition, inno- 
vative methods such as social network analysis might 
be applied to gain insight into the strength of parent- 
professional and inter-professional relationships as a 
proxy for success in integrated care [38]. 



Reviewers 

Stephen J. Gentles, MSc, McMaster University, 
Department of Clinical Epidemiology & Biostatistics, 
1280 Main St W, Hamilton, ON, L8S 4K1, Canada 

K. Ann McKibbon, PhD, Associate Professor, McMas- 
ter University, Department of Clinical Epidemiology & 
Biostatistics, 1280 Main St W, Hamilton, ON, L8S 4K1, 
Canada 

Ingrid Mur-Veeman, Department of HSR, Maas- 
tricht University, School for Public Health and Primary 
Care (CAPHRI), Faculty of Health, Medicine and 
Life Sciences, P.O. Box 616, 6200 MD Maastricht, 
Netherlands 

Christopher Stille, MD, MPH, Professor and Head, 
General Academic Pediatrics, University of Colorado 
Denver/Children's, Hospital Colorado, 13123 East 16th 
Avenue, B032, Aurora, CO 80045, USA 

One anonymous reviewer. 



Appendix 



Table X1. System aims and corresponding functional specifications and technical requirements [31] 



Aims 


Functional specifications 


Technical requirements 


Patient 
centeredness 


- Enable parents to consult the professionals involved in 
their child's care when necessary 

- Enable professionals to consult parents when 
necessary 

- Enable consistency of information in the response 
provided to parents 


- Overview of the child's care network in which parents can tick mark 
one or more professionals for consultation 

- Overview of the child's care network in which professionals can tick 
mark the child's parents for consultation 

- Parents' assignment of one feedback-responsible professional for 
the consultation question 


Inter- 
professional 
contact 


- Enable professionals to consult other professionals 
involved in the child's care 

- Notify professionals as soon as they are consulted or 
responded to 

- Enable inter-professional conference prior to feedback 
to parents 


- Overview of the child's care network in which professionals can tick 
mark one or more professionals for consultation 

-Automatic email-alerts with a hyperlink to the submitted question or 
response 

- Submitted reactions from professionals only visible among involved 
professionals 


Network 
transparency 


- Stimulate network contact over one-to-one 
interactions 

- Enable network-wide insight in the consultations 
conducted 

- Provide an up to date overview of which professionals 
are involved in the child's care network 


-Automatic copy of submitted question to other professionals in the 
child's network (if preferred, parents can remove these automatic 
copies) 

- Up to date overview of the child's care network, specifying names 
specialities and affiliations of the professionals involved 


General aims 


- Provide open access information about system aims 
and procedures 

- Warrant safe information exchange 

- Enable independent system administration and 
assistance to system users when needed 

- Up to date information regarding personal details 


- Generally accessible website with project related information 

- Secure log-in with SSL-encryption and retyping an alphanumerical 
code 

-Administrator menu for registration of system users and helpdesk 
function 

- Personal menu in which parents and professionals can edit their 
personal details 
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Table X2. Questionnaire items at baseline (TO) and after the pilot (T1). Items marked with * were assessed by means of a scoring table in which 
parents could indicate their response for each involved professional 





TO 


T1 


Sufficiency of 
contact 


With this professional* I [rarely] [occasionally] [usually] 
had sufficient contact during the past 6 months 


For this professional* system use had [scarcely] [to some 
extent] [considerably] contributed to sufficient contact 


Timeliness of 

information 

exchange 


With this professional I [rarely] [occasionally] [usually] had 
timely information exchange during the past 6 months 


For this professional system use had [scarcely] [to some 
extent] [considerably] contributed to timely information 
exchange 


Appp^^ihilitv of 

professionals 


Thic; nrofpc;ciinn??l* wa<; frarplvl fnccacunnallvl fi 7<?/ mllvl 

1 1 MO t~J \ W 1 t>OOI U 1 IC4I VV CIO / / Ca 1 ^ ' V J / wuUQO/ \JI 1 Ca 1 1 y J /WOC#CI/IJr/ 

accessible for consultation during the past 6 months 


For thic; nrnfpc;ciinnal* w^tpm mc;p had f^rarrplvl ftn wmp 

1 \Jl 11 MO Ul UIUOOIUI lul OVO ICI II UOC 1 1 CX\A / OOCI/ y J / L \J OUi 1 l\s 

extent] [considerably] contributed to better accessibility 
for consultation 


Consistency of 
information 


Of this professional* 1 [rarely] [occasionally] [usually] 
received consistent information about my child's care 


According to your experience, did system use contribute 
to obtaining consistent information?/"5-po/>?f Likert-scale, 
ranging from 'no, not at all' to 'yes, definitely] 


Parents as care 
coordinator 


With this professional* 1 [rarely] [occasionally] [usually] 
had to act as care coordinator in order to manage my 
child's care during the past 6 months 


Did you, as a result of using the system, less often have 
to act as care coordinator in order to manage your child's 
care? 

[5-point Likert-scale, ranging from 'no, not at all' to 'yes, 
definitely] 


Parents as 
messenger of 
information 


In the communication among the rehabilitation physician 
and this professional* 1 [rarely] [occasionally] [usually] 
had to act as messenger of information during the past 6 
months 


Did you, as a result of using the system, less often have 
to act as messenger of information among involved 
professionals? 

[5-point Likert-scale, ranging from 'no, not at all' to 'yes, 
definitely] 
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